Sttreaming Video Textures for Mixed Reality Applications in Interactive Ray Tracing Environments
نویسندگان
چکیده
The realm of mixed reality applications lies in blending rendered images with images of the real world. This requires highly realistic rendered images in order to seamlessly blend between those two worlds. However, current rasterization technology severely limits the achievable realism and imposes strict limits on the scene complexity and the optical effects that can be simulated efficiently. Real-time ray tracing can overcome many of these constraints and enables completely new approaches for mixed reality applications. This paper explores this design space based on a framework for live streaming of video textures in a real-time ray tracing engine. We also suggest a novel approach to video-based AR by integrating image compositing with shading computations. We demonstrate the approach with a number of VR/AR applications including video inserts, video billboards, and dynamic lighting from video and HDR video streams. Being seamlessly integrated into the ray tracing framework, all our applications feature ray traced effects, like shadows, reflections and refraction.
منابع مشابه
Interactive mixed reality rendering in a distributed ray tracing framework
Photo-realistic rendering methods are required to achieve a convincing combination of real and synthetic scene parts in mixed reality applications. Ray tracing is a long time proved candidate, but when it comes to interactive frame rates GPU based rendering has usually been preferred. Recent advances in distributed interactive ray tracing suggest to explore also its potential for mixed reality ...
متن کاملInteractive Ray Tracing for Virtual TV Studio Applications
In the last years, the well known ray tracing algorithm gained new popularity with the introduction of interactive ray tracing methods. The high modularity and the ability to produce highly realistic images make ray tracing an attractive alternative to raster graphics hardware. Interactive ray tracing also proved its potential in the field of Mixed Reality rendering and provides novel methods f...
متن کاملکاربردهای محیط مجازی در حوزه سلامت
Introduction: Virtual reality was posed coinciding technology developing, creating user-interfaces, high-speed processing and powerful graphic. Virtual reality technology and video games can participate in providing health care with creating simulated, motivational, interactive and realistic environments. Integrating virtual simulation with video games has been proven in creating motivation and...
متن کاملFiltering Environment Illumination for Interactive Physically-Based Rendering in Mixed Reality
Physically correct rendering of environment illumination has been a long-standing challenge in interactive graphics, since Monte-Carlo ray-tracing requires thousands of rays per pixel. We propose accurate filtering of a noisy Monte-Carlo image using Fourier analysis. Our novel analysis extends previous works by showing that the shape of illumination spectra is not always a line or wedge, as in ...
متن کاملInteractive reconstruction of virtual environments from video sequences
There are many real-world applications of Virtual Reality requiring the construction of complex and accurate threedimensional models that represent real environments. In this paper, we describe a rapid and robust semi-automatic system that allows such environments to be quickly and easily built from video sequences captured with standard consumer-level digital cameras. The system combines an au...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003